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Abstract — In this paper, a dynamic antiwindup compensator 
design is proposed wliicli augments tlie main controller and 
guarantees robust performance in the event of input saturation. 
This is a two stage process in which first a robust optimal 
controller is designed for an uncertain linear system which 
guarantees the internal stability of the closed loop system and 
provides robust performance in the absence of input saturation. 
Then a minimax linear quadratic Gaussian (LQG) compensator 
is designed to guarantee the performance in certain domain of 
attraction, in the presence of input saturation. This antiwindup 
augmentation only comes into action when plant is subject to 
input saturation. In order to illustrate the effectiveness of this 
approach, the proposed method is applied to a tracking control 
problem for an air-breathing hypersonic flight vehicle (AHFV). 



I. INTRODUCTION 

The design of a controller for a linear system with input 
saturations is a challenging task. Input saturation can have a 
disastrous effects [1]. In general, it is common to consider 
control problem involving integral action and in the presence 
of input saturations, the state of the integrator can wind up 
and affect the response of the underlying system. Engineers 
using PI and PID control have solved the windup problems 
using ad hoc measures, such as by resetting the integral 
states in the case of windup, or by using a modified digital 
implementation of the controller, which does not depend on 
the integral error terms. However, these ad hoc measures 
lack mathematical rigor and are mostly heuristic [2], [3]. 
Attempts have also been made by control system designers 
to penalize the control output so that actuator limits would 
never be violated. These method are useful to some extent 
but may result in a design which is too conservative and 
unable to utilize the full capability of the available control 
authority. 

In order to use full controller authority of the controller 
and to recover the nominal performance of the system in the 
event of actuator saturation, considerable attention has been 
given to antiwindup augmentation over the last decades. The 
main advantage of using an antiwindup augmentation scheme 
is that the system will operate with its full capability in 
term of robustness and performance in the absence of input 
saturation. The antiwindup correction only come into effect 
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in an event of input saturation. Antiwindup augmentation, as 
the name suggests, is a two-stage design procedure. In this 
design procedure, the requirement of small signal behavior of 
the nominal system is guaranteed by ignoring the saturation. 
Then antiwindup compensation is added to recover the 
nominal performance in the presence of saturation. 

Noting the importance of the antiwindup augmentation to 
handle saturation, different methods have been appeared in 
the literature over the decades. Most of the methods relying 
on the Hoo optimal control approach have considered the 
antiwindup problem as an £2 gain minimization problem 
[4], [5], [6], [7], [8]. In these papers, saturation nonlinearities 
are considered as a sector or dead-zone type nonlinearities 
and the antiwindup problem is solved by formulating it in a 
convex optimal framework. In [6], [9], [10], linear fractional 
transformation (LFT) and linear parameter varying (LPV) 
approaches have been proposed for parameter-varying satu- 
rated systems. All of these methods employs linear matrix 
inequalities (LMIs) as a tool to compute global optima in a 
simplified way. The main drawback of the LMI framework 
is that in several situations LMI constraints are unfeasible 
and hence no solution exists. Also, LMI methods can suffer 
from numerical and computational problems in the case of 
high order system. These problems are solved to some extent 
in [8] by characterizing the antiwindup problem in terms of 
a nonconvex feasibility problem, which reduces to a convex 
feasibility problem when a certain rank constraint becomes 
inactive. Another solution of this problem is attempted in 
[11] where, the non-feasible problem was solved based on the 
approximate solution of an LMI. The results of [8], [11] are 
only applicable to linear stable plants. Antiwindup controller 
design for an unstable system was considered in [5] which 
is also based on the LMI method. However, the results are 
only valid when no uncertainty exists in the original system 
except for the uncertainty due to the actuator saturation. 

In this paper we have considered stabilizable unstable 
linear systems subject to parameter uncertainties and input 
saturations. The formulation of the antiwindup problem is 
based on an Hoo framework. In this framework a dynamic 
antiwindup compensator is proposed, which solves a risk- 
sensitive control problem using the minimax LQG (a robust 
version of LQG control) design method [12]. This is similar 
to the £2 gain optimization problem. The only difference 
is that in minimax approach, we minimize the upper bound 
on a time averaged cost function and guarantee the robust 
performance. This method not only allows for the uncer- 
tainty which arises from saturation nonlinearities but also 
accounts for uncertainties present in the original system. In 



the propose method, a suitable robust controller is obtained 
by ignoring actuator saturation and then the closed loop 
system is augmented by a robust antiwindup compensator 

The proposed antiwindup controller is then applied to 
solve the actuator saturation problem in an air-breathing hy- 
personic flight vehicle. The control problem in this example 
poses significant challenges as it offers a challenging trade- 
off among conflicting requirements. In high speed aircraft, 
the model is subject to parameter uncertainties due to a 
large flight envelop and a good robust controller is required 
to be designed. However, in the absence of antiwindup 
augmentation, limited control authority seldom allows the 
robust controller to work in its full capacity and thus degra- 
dation in the performance is unavoidable. The antiwindup 
compensator proposed in this paper solves these problems 
quite effectively and can be easily implemented on-board 
the aircraft. 

The paper is organized as follows. Section|lI]describes the 
class of uncertain linear systems and uncertainties considered 
in the paper Section |lll] describes the general antiwindup 
problem and the synthesis of an antiwindup compensator 
using the minimax LQG method. The application of the 
proposed method to an AHFV control problem along with 
simulation results are presented in Section |IV] The paper 
is concluded in Section |V] with some final remarks on the 
proposed procedure. 

II. System Definition 

Consider an unconstrained uncertain linear unstable plant 
given by 

I 

x{t) = Ax{t) + Bu{t) + ^ CjCj-; 

^=1 (1) 

Zi{t) — Kix{t) + Giu{t); i — 1,2, ■ ■ ■ ,m 

y{t) = C2x{t) + D2u{t) 

where x{t) e R" is the plant state, u{t) e M"" is the control 
input, Qj e M""^ is the uncertainty input, Zi{t) e M"" is the 
uncertainty output, y S M"" and A, B, Cj, Ki, d, C2, and 
D2 are the matrices of suitable dimensions. Assume also 
that the uncertainty in the system satisfy following integral 
quadratic constraint condition (IQC) [12] 

/•oo 

/ (II f - II r)dt > -x'^{0)d,x{0), (2) 

where dj > for each j ^ 1, ■ ■ ■ ,1 is a given positive 
definite matrix. Also, assume a minimax optimal linear 
quadratic regulator (LQR) control [13] of the following form 
exists for the system ([TJ which is well posed and guarantees 
internal stability of the closed loop system: 

u{t) = -GrX{t), (3) 

where 



Here, X^- is obtained by solving a game type Riccati 
equation 

{A - BE-^G^KfXr + Xr{A - BE'^G'^K) 

+ Xr{CC^ - BE-^B^)Xr + K^{I - GE-^G^)K = 0, 

(4) 
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for given parameters ti > 0, T2 > 0,...,r/ > 0. The 
parameters tj for j = 1 , • • • ,1 are selected such that they 
give a minimum value of a bound on the following cost 
function 

/>oo 

F = / [x{tfQxt) + v{tfBM{t)]dt, (5) 

where, Q — > and R — BF > are the state and 
control weighting matrices respectively and the solution Xt 
of the Riccati equation (HJi should be symmetric and positive 
definite. The bound on the cost function is given as 

; 

mm[x'^ {Q)Xrx({)) + ^ t^x'^ {Q)djx{0)], (6) 
j=i 

where the initial condition a::(0) 7^ € M" is assumed to be 
known. Alternatively, the initial condition can be assumed to 
be a zero mean unity variance random vector, in which case 
the trace of the matrix in ^ would be minimized. 

Theorem 1: Consider the uncertain linear system ([T]) with 
cost function (|5]). Then for any ti > 0, r2 > 0,...,t; > such 
that Riccati equation (|4|i has a positive definite solution, the 
controller (O is a guaranteed cost controller for this uncertain 
system with any initial condition x{Q) e M". Furthermore the 
corresponding value of the cost function ( |23] | is bounded by 
the quantity ^ for all admissible uncertainties and moreover, 
the closed loop system is absolutely stable. 

Proof: See [12], [13]. ■ 

III. The Antiwindup Problem 

In real control problem, the input u{t) is subject to satu- 
ration and thus the control law (O may not give satisfactory 
performance. Indeed, each component u, of the input vector 
u is subject to a saturation nonlinearity of the form shown 
in Fig. I2] The antiwindup problem here is to design a 
suitable antiwindup compensator which guarantees adequate 
performance of the closed loop system in the presence of 
saturation nonlinearity. We represent saturation nonlinearity 
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Fig. 1: Closed loop system structure with antiwindup aug- 
mentation. 



as a deadzone type sector bounded uncertainty and defines 
corresponding deadzone function 4>i{ui) as follows: 

^[ 0, k|<k„_| (7) 

I sgn{u,){u, - \u,^^J), \u,\ > |m,„„J 

where, Ugat is the input vector which is subject to saturation. 
Also, we augment the controller in (O with an antiwindup 
augmentation (see Fig. [T]) as follows: 



l{t) = -GrX{t) + V, 



(8) 



where v is the signal from the antiwindup compensator of 
the form 



(9) 



where Aaw, Baw and Caw are the matrices of suitable 
dimension and ( is the input to the compensator. The 
procedure to obtain these matrices will be given in sequel. 

A. Antiwindup controller design 

The design of an antiwindup augmentation system for 
the uncertain linear system is designed by defining a new 
equivalent uncertain model, considering the saturation non- 
linearities as sector bounded uncertainties (deadzone type) 
and then froming an equivalent closed loop system using (jSJ. 
Firstly, we define a domain of attraction by restricting 
Ui G [^ijUi] for i = 1, • • • ,m where, Ui is the maximum 
allowed value of Ui and u^ is the minimum allowed value 
of Ui. The corresponding sector bound can be selected by 
appropriately choosing < < 1 (see Fig. |2] and Fig. O 
and by using the following equation. 



(10) 
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Fig. 2: Control input saturation. 




Fig. 3: Deadzone uncertainty representation with domain of 
attraction. 



Also, note that = — Ui,„„^- The open loop system 

can be written using ^ considering all input saturations as 
follows: 



x{t) = Ax{t) + Busat + XI CjO; 



^Ax{t)+B{u-4>{.))+Y.'^i^f^ (11) 

= Ax{t) +Bu- B(P{.) + J2 QO; 

where, (/)(•) = • • • , 

The sector bound on each (j>i{ui) for i — 1, - ■ ■ ,m can be 
written as follows: 



u 

< (t){ui)ui < eiu}. 
We then define a new uncertainty input as 

Wi{Ui) = (j)i{Ui) - 
=4> w{Ui) + ^ (j)i{ui), 



(12) 



(13) 




where 



Fig. 4: Uncertainty representation with new sector. 



and write the uncertainty corresponding to this uncertainty 
input in a new sector as follows: 

,2 



< Wi{Ui)Ui + -y^ = Mui)Ui < Eiuf 



(14) 



Also, the sector bound (fT4l i on the saturation uncertainty can 
be written in the following form (See Fig. |4]i. 

£t\Ui\ 



\z\, 



(15) 



2 



where, z 

Remark 1: The formulation presented here is applicable 
to the case where |ui„;„| = l^ii,„ai^|; i-S- the symmetric 
saturation case (see Fig. |2]). However, it is straightforward 
to extend this formulation to the asymmetric saturation case 
where ^ 

We can satisfy the bound (fTTI) using the new uncertainty 
in ( fTSb as follows: 



x{t) = Ax{t) + Bu - 
x{t) = Ax{t)+B{l 



.7 = 1 

" 2- 



(16) 



where, w(-) = • • • , m„i(-u„i)]^, <£ = 

(i«a(7[ei, • • • B = B{1 — -1), G is a scaling matrix 

corresponding to the bound in ( fTsT i as given below: 

" e,/2 ■■■ " 
G= ... . (17) 

e„/2 _ 

Since, we have considered additional uncertainties cor- 
responding to the saturation uncertainties in ( fTSI l. the un- 
certainty outputs of the original system ([U along with the 
uncertainty output z corresponding to w can be written as 
follows: 

z = Kx + Gu, (18) 
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Also, we can write the complete uncertain linear model 
of the system in the presence of actuator saturation as given 
below: 



x{t) = Ax{t) +Bu + Y^ GjQ - Bw{-), 



(19) 



z = Kx + Gu. 



The minimax optimal controller in dHJ can be used to 
obtain closed loop system which guarantees stability for 
the uncertain system ([U without saturation uncertainty. The 
closed loop system incorporating the antiwindup signal v in 
(fT9] i can be written as follows: 



x{t) = Ax{t) + B{Gx + w) + CjQ 



3 = 1 

I 



Bw{-), 



(20) 



{A - BG)x{t) +Bv + ^ GjQ - Bw{-) 



In a similar way using (|8]l in (T% . the uncertainty output can 
be written as follows: 



z = Kx + G{Gx + u), 
^{k + GG)x + Gv. 



(21) 



Finally, we can write the closed loop system considering 
saturation uncertainty with antiwindup signal v as follows: 



X = Ax{t) + Biv + B2C, 
z = Gix + Div, 
y = C2X + D2C, 



where, A = {A - BG), Gi 
Bi = i?, 6*2 = 0, 



B2 

C-- 



= [ Gi G2 
[ Ci C2 • 



K + GG, D2 
Ci ~B], 

M-) 1^. 



(22) 



[0 I], 



B. Minimax LQG controller synthesis for antiwindup aug- 
mentation 

We now design an antiwindup controller of the form (|9]l 
using minimax LQG design procedure. The design procedure 
for the standard minimax LQG is given in [12]. Here, we 
present a summary of the method and then present our 
approach to designing a minimax LQG antwindup controller. 
The controller (|9]l can be designed after stabilizing the system 
([T]i using (|3]l and writing the closed loop system in the 
form (|22] |. The minimax LQG control problem [12] involves 
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Fig. 5: Scaled Hoo control problem. 



finding a controller which minimizes the maximum value of 
the following cost function: 

1 F 

J= lim — E / {x{tfQx{t) + v{tfRv{t))dt, (23) 

where R > and Q > 0. The maximum value of the cost 
is taken over all uncertainties satisfying the IQC (|2]i. If we 
define a variable 



the cost function ( |23] ) can be written as follows: 



(24) 



(25) 



The minimax optimal controller problem can now be 
solved by solving a scaled risk-sensitive control problem [12] 
which corresponds to a scaled Hoc control problem; e.g. see 
[14]. The scaled risk-sensitive control problem considered 
here (see Fig. |5]l allows for a tractable solution in terms of 
the following pair of Hoo type algebraic Riccati equations 
for C2 = 0.: 



+ B2{I - D2^r-^D2)B2^ 



0, 



(26) 



and 



{Rr - T^G^^T^) = 



{A - BiG-^TlfXo 



(27) 



where, 

Rr =Q+tCi^Ci, 



Gr = R+TDi Di, r^=rGi Di 



In order to obtain solutions to both of the algebraic Riccati 
equations Y^o > 0, X^o > 0, the system (l22T i is required to 
satisify the following assumption: 
Assumption 1: 



7. Rr-TrG-^Tl>0 

8. The pair {A - BiG-^T^^Rr - T^G-^T^) is de- 
tectable. 

9. The pair {A, ^2(1 - D1^T-^D2)) is stabilizable. 

If the solutions of the Ricatti equations satisfy / — 
T^^YooXoo > and the parameter r > is chosen such 
that it minimizes the cost bound (Wr) defined by 



Wr^tr[iB2D2 ){D2Dl) 



X {D2B2 )X{I - YX) 



TYRr] 



(28) 



then the antiwindup controller matrices in (|9]l can be obtained 
as follows: 

Caw = ^{B^ Xao + T^r )) 

Ban, = (/ - T-'YooX^)-\B2Dj)r-^; 



A„ 



A + BiCaw + T-\B2 - B,D2)B^X, 



Theorem 2: Consider the uncertain linear system (l22l l 
with the cost function (l23l l and suppose assumption [T] is 
satisfied. Then the controller (|9]l minimzes the bound on the 
cost function (l23T l such that Wr(-) — inf^,(.) sup J(-) and 
guarantees the stability of the system (within certain domain 
of attraction) in the presence of saturation nonlinearity if the 
following conditions are hold for an arbitrary t > 0: 

1. The algebraic Ricatti equation (|26] | admits a minimal 
positive-definite solution Yoo- 

2. The algebraic Ricatti equation (|27] | admits a minimal 
nonnegative-definite solution Xoo- 

3. The matrix I — ^YooX^o has only positive eigenvalues; 
that is the spectral radius of the matrix Foo^oo satisfies 
the condition piYoaXoo) < t. 



Proof: See [12]. 



IV. Example 



In this section, we apply our proposed antiwindup syn- 
thesis approach to design a velocity and attitude tracking 
controller with antiwindup augmentation for an air-breathing 
hypersonic flight vehicle (AHFV). This design example 
has been taken from our previous work [15], [16] and it 
is observed that the AHFV system is subject to actuator 
saturation. Here, we use the uncertain linearized model 
of AHFV which was obtained using the robust feedback 
linearization method in [16]. The linearized model is 2- 
input and 2-output system which is subject to 24 uncertainty 
parameters pi, p2, • • • , P24- For the ease of reference the 
corresponding linearized model of the form ([T) is shown 
below: 



1. The matrix Ci and Di satisfy the condition C]^Di = 0. 

2. The matrix D2 satisfies the condition D2D2 > 0. 

3. A is Hurwitz. 

4. The pair {A, B2) is stabilizable and i?2 7^ 

5. The pair [A, Bi) is stabilizable and y{t) is measurable. 

6. The matrix B2 and D2 satisfy the condition B2D2 = 0. 



icit) = Ax{t) + Bv{t) + ^ G,0; (29) 

z,{t) = K,x{t) + G^v{t)- 1=1,2 (30) 
yit) = C2xit) + D2v{t) (31) 



where, 



A 



Ci = 






1 
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Bound on the cost fucntion 
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6: Bound on the cost function with varying r. 
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. ^«^1(P24) . 




. AW^2(P24) . 



and xit) G is the state vector, and v{t) — [vi V2]'^ & 
is the control input vector. Note that the size of matrix Cj is 
9 X 24. Also, Ci € M^"*, and (2 e R^* are uncertainty inputs, 
zi{t) g M^^, and Z2{t) G M^^ are the uncertainty outputs, 
Aw(.) and Aw(^.) represent the magnitude of the uncertainties 
in the system. 

As a first step, a controller of the from (O is designed 
which gives a stable close loop system in the absence of 
actuator saturations as discussed in the Section HI] In the 
second step, we augment the controller with antiwindup 
compensation dS) so that the performance degradation is 
minimized and system remains stable in the selected domain 
of attraction as discussed in Section [III] The antiwindup 
compensator of the form (|9]l is obtained by selecting ap- 
propriate state and control weighting matrices Q and R. For 
this example, the following parameters are selected to obtain 
a good antiwindup controller: 

Q = 1000 X diag [ 1, 1, 1, 1, 1, 1,1,1,1], (32) 



R 



3 
8 



, T = 35. 



(33) 



The parameter r has been selected which gives the minimum 
cost bound ( |28] ) as shown in Fig |6l 

Remark 2: The selection of state and control weighting 
matrices plays a significant role in the synthesis of the 



minimax LQG antiwindup controller. The selection should be 
made such that the dynamic gain of the closed loop transfer 
function should not be too high or too low. The antiwindup 
signal V should be smaller than the actual input u. 

A. Simulation Results 

Simulation results using the antiwindup augmentation pro- 
cedure discussed above are shown in Fig. |7} Fig. [8] The 
solid (blue) line shows the response of the nominal system 
without actuator saturation, the dashed (red) line shows the 
response with the actuator saturation and the dashed-dot 
(black) line shows the response with the antiwindup aug- 
mentation compensator The results show that in the presence 
of actuator saturation, the antiwindup augmentation removes 
the actuator saturation degradation in a very effective way. 
The tracking errors remain small and bounded for both the 
cases of velocity and altitude reference input commands. 

V. Conclusion 

In this paper, a minimax linear quadratic Gaussian (LQG) 
antiwindup augmentation compensator has been proposed for 
an uncertain linear plant subject to input saturation. The de- 
sign employs a two-stage process in which a robust controller 
is designed using minimax linear quadratic regulator (LQR) 
without considering actuator saturation as the first step. 
Then antiwindup augmentation is provided in the second 
step. The proposed approach has been applied to a tracking 
control problem for an air-breathing hypersonic flight vehicle 
(AHFV) system. Simulation results show that the proposed 
approach is very effective in dealing with actuator saturation. 
It is observed that the proposed antiwindup augmentation, 
reduces the degradation in performance. Antiwindup designs 
for nonlinear uncertain systems using feedback linearization 
are areas for future research. 




Fig. 7: Velocity and altitude tracking error responses. The 
solid line shows the response with the nominal model, '- 
-' shows the response with input saturation, shows the 
response with antiwindup augmentation. 



Fig. 8: Controller output responses. The solid line shows the 
response with the nominal model, '- -' shows the response 
with input saturation, shows the response with antiwindup 
augmentation. 
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